EFFECTS OF MEASUREMENT ERRORS ON 
PARAMETER ESTIMATION VIA NEURAL 

NETWORKS 


By 

Srinivasa Rao Chintala 


1 

A*''*- 



DEPARTMENT OF AEROSPACE ENGINEERING 

INDIAN INSTITUTE OF TECHNOLOGY, KANPUR 

DECEMBER. 1998 



EFFECTS OF MEASUREMENT 
ERRORS ON PARAMETER 
ESTIMATION VIA NEURAL 
NETWORKS 


A Thesis Submitted 

in Partial Fulfillment of the Requirements 
for the Degree of 

Master of Techrfology 


by 

Srinivasa Rao Chintala 



Department of Aerospace Engineering 

Indian Institute of Technology 

Kanpur 

December, 1998 



CERTIFICATE 

It is certified that the work contained in the thesis entitled, “EfiFects of Mea- 
surement Errors on Parameter Estimation via Neural Networks” , by 
Srinivasa Rao Chintala, has been carried out under our supervision and that 
this work has not been submitted elsewhere for a degree. 


Dr. S. C. Raisinghani 
Professor 

Department of Aerospace Engg. 
I.I.T., Kanpur. 



Dr. A. K. Ghosh 
Department of Aerospace Engg. 
LIT., Kanpur. 

December, 1998. 






Acknowledgements 


I wish to record my deep sense of gratitude to my esteemed teachers 
and thesis supervisors, Dr. S.C. Raisinghani and Dr. A.K. Ghosh for 
their meticulous guidance, invaluable suggestions, constructive criticism and 
constant encouragement during the tenure of this thesis work. I shall always 
remain indebted to them for the precious time they have spared for me and 
the patience with which they always enlightened my path. 

With all sincerity, I thank Dr. P.K. Kalra, the professor of Electrical 
Engg. Deptt., for his guidance in understanding Neural Networks and its 
applications. 

I express my special thanks to my friends Mr. G.V.S. Bhaskar Reddy, 
Mr. K. Janardhana Reddy and Mr. P. Narayana Rao for their tremendous 
help in bringing this work to the present form. 

No words can be coined to express my deep sense of gratitude to my 
parents and my youngers who have been a constant source of inspiration to 
me. 


Finally, I wish to acknowledge all the friends and faculties, who were a 
part of the process of intellectual enrichment and personal growth in many 
aspects of my life, in this year and a half stay at IIT, Kanpur. 

Srinivasa Rao Chintala 
IIT, Kanpur. 



Abstract 


Recently, two methods based on feed forward neural networks, christened 
“the Delta method” and “the Zero method”, have been proposed for estimat- 
ing aircraft stability and control derivatives (parameters) from flight data. The 
methods have been validated on simulated as well as real flight data wherein the 
flight data used were either without any measurement errors, or were corrected 
for the measurement errors before their use for parameter estimation. In the 
present work, scope of both the Delta and the Zero methods is expanded by 
investigating their ability to extract parameters from raw sensor data without 
prior corrections for possible measurement errors like the bias, scale factor, 
measurement noise, etc. Results are presented for simulated data with vary- 
ing amounts of measurement errors. It is . shown that the Delta method can 
be applied directly to the recorded flight data that may have errors of bias, 
scale factor, and measurement noise. However, the recorded data needs to be 
corrected for the time shift errors. Finally, real flight data is used with and 
without correcting it for the bias and scale factor, and the resulting parameter 
estimates via the Delta method are shown to compare well with the estimates 
via the maximum likelihood method. 
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Chapter 1 


Introduction 


During the last three decades, the field of system identification has emerged 
as an important discipline. Application of this field finds a place in variety 
of disciplines like Aerospace engineering, Chemical engineering, Metallurgical 
plants, and so on. The general problem of identifying a system based on 
measurement of input and output variables is defined as obtaining functional 
relationship between the inputs and outputs. 

Among all the subfields of system identification, the most widely ap- 
plied is that of parameter estimation, wherein an assumed mathematical model 
based on phenomenological considerations is used to estimate the properties of 
the dynamic system. The assumed model, however, will not be an exact repre- 
sentation of the system, no matter how careful its selection is. To reduce this 
difference, the objective is redefined in terms of parameter estimation which 
attempts to maJce the mathematical model the best possible representation of 
the essential characteristics of the system. 

One of the successful application of this subfield (parameter estimation) 
is the estimation of numerical values of aerodynamic stability and control 
derivatives (aircraft parameters) from flight test data. The reasons behind 
this success are: 
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1. the dynamics of an airplane is well understood and can be appropriately 
modelled 

2. better measurement techniques and data processing 

3. better estimation algorithms made possible by ever increasing computa- 
tional power of digital computers. 

Three distinct approaches for estimating aircraft parameters are: 

1. Theoretical Methods 

2. Wind Tunnel Testing 

3. Flight Testing 

At the initial stages of aircraft design, theoretical methods^ provide the 
only convenient way of estimating the aircraft parameters. However, the the- 
oretical estimates are not accurate enough for many difficulties. On the other 
hand, the wind tunnel methods, although more reliable, are time consuming, 
expensive, and also suffer from discrepancies due to interference effects of sup- 
port system, wall effects, turbulence level, etc. As a final verification, it \s^ 
therefore, desirable that the aircraft parameters be estimated from the actual 
flight test data. 

The most commonly used methods for parameter estimation from flight 
data are broadly classified into the following categories. 

• Equation error methods 

• Output error methods (the maximum likelihood method being the most 
popular) 

The principle of least squares is used in the equation error methods, the 
error gets minimized with respect to the unknown parameters in each of the 
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equations. Its advantages includes computational simplicity, non-iterative na- 
ture and applicability to both linear and nonlinear models. In the output error 
methods, the error between the measured and the model response produced by 
identical inputs is minimized. The method assumes that there exists no mod- 
elling errors. This method processes the measurement noise while assuming 
the model representation of the given system to be exact. The maximum like- 
lihood (ML) estimator and its several variants have been the most successfully 
used methods for estimating parameters from flight data."^’® 

The above mentioned methods require accurate measurement of input- 
output variables. This requirement is difficult to meet in practice due to many 
types of measurement errors present in data. A few typical measurement errors 
present in data are: the bias (also called zero shift), scale factor, time shift 
and measurement noise. For conventional parameter estimation methods, it 
is, therefore, required that the data compatibility check (sometimes referred to 
as flight path reconstruction) be performed to get accurate results. Thus, the 
data compatibility clieck becomes an integral part of the process of parameter 
estimation. 

The data compatibility is performed by using the standard kinematic 
equations, and applying a Kalman filter or ML algorithm.® The compatibility 
check provides an accurate information about the aircraft states, and also esti- 
mation of biases, scale factors and time shifts in the recorded data. Elimination 
of such errors from flight measurements prior to estimation of parameters helps 
to improve accuracy of estimates. However, the process of data compatibility 
check for estimation of errors can itself be quite sensitive to the methodol- 
ogy employed, and at times, it may be as time consuming as the process of 
estimating parameters itself. 

Recently, a new thrust area has emerged in the area of aircraft aerody- 
namic modeling and parameter estimation: development of techniques using 
artificial neural networks (ANNs) for flight vehicle identification. The ANNs 
have been successfully used for modeling in various fields such as signal pro- 
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cessiBg, pattern recognition, system identification and control, and so on. 


Historically, ANNs were developed out of continued interest in the con- 
structional and functional details of the human brain, and the research there- 
upon to understand its neurological capabilities such as its ability to learn, to 
retain and to recall information on demand. 

A class of artificial neural networks called the feed forward neural net- 
works (FFNNs) are most widely used among all types of ANNs for aircraft 
modeling. As plenty of literature is available on FFNNs, here we present only 
a brief outline about them. The FFNNs have neurons arranged in layers like 
directed graphs, and these are static in nature. FFNNs lead to a black box 
model in which no physical significance can be assigned to either the net- 
work structure or to the network weights. FFNNs work as general function 
approximators, and are capable of approximating any continuous function to 
any desired accuracy by an appropriate network architecture.^ This ability of 
FFNNs has been utilized to model aircraft aerodynamics successfully. 

Very recently, Raisinghani et al have used FFNNs for modeling aircraft 
aerodynamics wherein measured responses and control inputs are mapped to 
the aerodynamic coefficients; such a neural model is subsequently used to esti- 
mate aircraft parameters by the Delta method and the Zero method proposed 
in Ref. 12. It is also mentioned that the FFNN modeling does not require any 
a priori postulation of the mathematical model for the aircraft aerodynam- 
ics. Applicability of the Delta method and the Zero method for estimation 
of laterad-directional parameters from simulated as well as real flight data has 
been demonstrated, respectively, by Ghosh et al^^ and Raisinghani et al.^^ 

However, both the simulated and real flight data analyzed in Refs. 13 
and 14 had no measurement errors except for the measurement noise, i.e., no 
bias, scale factor, or time shift errors were present. For the real flight data, 
estimates from the data compatibility check for the bias, the scale factor and 
the time shift were used for correcting the data before being used for parameter 
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estimation via the Delta method‘s and the Zero method.*'* 


The conventional methods like the ML method postulate a model of the 
aircraft, and define a cost function based on the difference between the model 
and the aircraft responses for identical control inputs. Because the model 
response has no measurement errors while the measured response might have 
bias, scale factor and time shift errors, it becomes necessary to remove such 
errors from the measured data before the cost function is defined. In contrast, 
FFNN model does not require an a priori model of the aircraft; it maps the 
motion and control variables to the total aerodynamic coefficient to yield an 
aerodynamic model of the aircraft. Such a model is then utilized by the Delta 
method to estimate parameters. It W8is, therefore, conjectured that the use 
of a neural model to estimate parameters via the Delta method might not be 
affected by the presence of measurement errors in the motion/control variables, 
and thus permit use of the recorded data directly, i.e., without being first 
corrected for the measurement errors. 

In the present work, both the Delta and the Zero methods are used for 
extracting parameters from 1) simulated flight data corrupted with bias, scale 
factor and measurement noise, and 2) from recorded (real) flight data that 
axe not corrected for the bias and the scale factor errors. For both cases, 
the parameter estimates are compared with the estimates obtained from the 
corresponding flight data that either do not have the measurement errors (sim- 
ulated data), or are corrected for the bias and scale factor prior to their use 
for parameter estimation (real flight data). The results show that the Delta 
method is capable of estimating parameters from the raw data using the mea- 
sured values of the motion variables that are not corrected for the bias and/or 
the scale factor. 

Specifically, various aspects of application of FFNN to aircraft lateral- 
directional aerodynamics, details about the Delta and the Zero methods, and 
estimation of parameters from simulated and real flight data containing differ- 
ent levels of measurement errors are dealt as follows: 
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• In Chapter 2, a brief discussion about the FFNN is presented, and the 
steps involved in the BPA are also given. 

• In Chapter 3, a detailed description of the methods used for parameter 
estimation, namely the Delta method and the Zero Method, is given. 

• Chapter 4 described the generation of simulated flight data, preprocess- 
ing of real flight data, and the lateral-directional aerodynamic modelling 
of an aircraft using FFNNs. 

• In Chapter 5, results for simulated flight data corrupted with bias, scale 
factor and measurement noise, and real flight data that are not corrected 
for the bias and the scale factor errors, are presented. 

• Chapter 6 discusses the conclusions drawn on the basis of results ob- 
tained. 
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Chapter 2 


Artificial Neural Networks 

2.1 Introduction 

“A Neural Network is an interconnected assembly of simple processing ele- 
ments, units or nodes, whose functionality is based on the biological neuron. 
The processing ability of the network is stored in the inter-unit connection 
strengths, or weights, obtained by a process of adaptation to, or learning from, 
a set of training patterns. ” 

Artificial neural networks (ANNs) are computational paradigms which 
implement simplified models of their biological counterparts, biological neural 
networks. Biological neural networks are the local assemblages of neurons and 
their dendritic connections , called weights. Accordingly, ANNs are character- 
ized by 

• Local processing in artificial neurons 

• Massively parallel processing, implemented by rich connection pattern 
between the neurons 

• The ability to acquire knowledge via learning from experience ^^ 

• Knowledge storage in distributed memory 
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Although the initial intent of ANNs was to explore and reproduce human 
information processing tasks such as speech, vision, and knowledge processing, 
ANNs also demonstrated their superior capability for classification and func- 
tion approximation problems. This has great potential for solving complex 
problems such as systems control, data compression, optimization problems, 
pattern recognition, and system identification. One of the application areas to 
Aerospace engineering problems is in the design of flight control systems based 
on artificial neural networks. In the present work, we have enhanced the scope 
of applicability of neural networks for aircraft parameter estimation. 

There axe many different ways in which we refer to the same type of neural 
networks technology. Neural networks are described as connectionist systems, 
because of the connections between individual processing nodes. They are 
sometimes called adaptive systems, because the values of these connections 
can change so that the neural network performs more effectively. They are 
also sometimes called parallel distributed processing systems, which emphasize 
the way in which the many nodes or neurons in a neural network operate in 
parallel. 

Among all types of ANNs, the FFNNs offer more flexibility, and thereby, 
have higher potential for future application for modelling aircraft dynamics 
and aircraft parameter estimation. 

2.2 Feed Forward Neural Networks 

FFNNs are multi layered perceptrons consisting of am input layer, am output 
layer and one or more hidden layers. The number of neurons (nodes) in the 
input and output layers axe determined by the number of input aind output 
variables respectively aind the number of neurons in the hidden layer is decided 
by the complexity of the problem. 

FFNNs are static in nature and are characterized by unidirectional flow of 


8 



variables i.e., inputs axe propagated through the hidden layers, to the output 
layer. Each node in the layer (input or hidden) is connected to each node 
in the next layer (either the hidden or output) through a connective weight. 
The nodes in the hidden layer(s) and output layer have a nonlinear activation 
function, e.g., sigmoidal or hyperbolic tangent function. The hidden nodes in 
FFNN have good approximation capability and thereby allow the network to 
build a model of arbitrary complexity between input(s) and output(s). 

Neural Network can operate only with data. During modelling with neu- 
ral networks, it is necessary to specify the structure of the pattern because 
the proper selection and representations of patterns greatly decides the per- 
formance of the network. The basic elements of neural network learning phase 
are called neurons, where all computing is performed. Fig. 2.1 illustrates the 
most common type of a simulated neuron. Each neuron collects the informa- 
tion from its abutting connections and produces a single output value. 
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2.2.1 Training Phase of FFNN 


During the training phase of FFNN, it tries to memorize the pattern of the 
learning data set. This phase consists of the following modules: 

1. Selection of neuron characteristics 

2. Selection of Topology 

3. Error minimization procedures 

4. Stopping Criteria of training 

Selection of Neuron characteristics 

Neurons can be characterized by two operations, namely, the aggregation and 
nonlinear filtering. Nonlinear filtering (some times called, Activation Func- 
tion) can be characterized by several functions, the sigmoidal and the tangent 
hyperbolic functions being the most common. 

Since most of the ANNs use the gradient method to minimize the error, 
points where the gradients are small should be avoided in the beginning of 
the process. Therefore to initialize the learning process, the central part of 
the function where the gradients are large is selected. This can be achieved 
by scaling proper input signals and the selection of the limit between which 
random weights are generated. For example, if the scaling of input is carried 
out between 0.1 and 0.9 then the random weights are preferred between - 
0.5 and -fO.o for standard sigmoidal function. A major drawback of these 
activation functions is it’s saturation which can cause significant errors when 
the output has no upper bounds. 
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Selection of Topology 


Topology of FFNN deals with i) number of layers and neurons in each layer 
and ii) their interconnections. Too few hidden neurons hinder the learning 
process, while too many occasionally degrade the FFNN generalization capa- 
bility. Unfortunately, there are no definite rules for selection of the topology 
of the network and yet, one has to find the best possible topology by trial and 
error, guided by a set of thumb rules available in literature. 

Error minimization procedures 

When FFNNs are trained, the weights are modified in order to minimize the 
error on the training patterns. Different functions can be used to caJculate the 
error. The most common being the MSE and is defined by 

1 n m 

p.i) 

where Y and X are, respectively, the desired and the predicted outputs; n is 
the number of data points; and m is the number of output variables. 

Different strategies are used for updating the weights of FFNN. In one 
approach, the weights are updated at every cycle of the entire set of training 
pattern presentations. This process is called the batch or periodic updating. 
In the second approach, the networks are updated continuously after each 
training pattern is presented. This approach is called online or continuous 
updating. 

Training of FFNN is influenced by selection of dijfferent tuning parame- 
ters. Learning rate (p) and Momentum rate (f2) influences the speed of learning 
in gradient descent technique. Licreasing the learning rate may improve the 
speed of learning but it can also cause oscillations. A proper selection of learn- 
ing rate parameter helps in achieve fast convergence to accurate estimates. 
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Even scaling parameters of sigmoidal function (well known as, Logistic gain) 
also influence the learning behaviour. 

Termination Criteria for learning 

The processing of adjusting weights are generally repeated until the termi- 
nation condition is achieved. So in practice, one has to specify termination 
conditions. The learning process can be terminated when 

• the error goes below a specific value 

• the magnitude of gradients reached below a certain value 

• specific number of iterations (I) is complete 

One can also terminate the learning process by cross validation technique. 
In this technique, data are divided into a training set and validation set. The 
training set is used to modify the weights, the validation set is used to estimate 
the generalization ability. Training is stopped when the error on validation set 
begins to rise. This technique may not be practical when only small amount 
of data is available. The first three criteria are sensitive to the choice of tuning 
parameters and may lead to poor results if the tuning parameters are not 
properly selected. , 

2.2.2 Training Algorithm - Back Propagation 

Back propagation network typically begins with a random set of small weights. 
The network then adjusts the weights each time it processes an input-output 
pair. Correction of weight in each pair requires two stages: a forward pass and 
a backward pass. In forward pass, outcome from input data is generated by 
flowing the signals in forward direction, from input to hidden and then from 
hidden to output layer. During the backward pass, the network’s actual output 
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(from forward pass) is compared with the target output and error estimates are 
computed. These errors are propagated in the backward directions to correct 
the weights between the two neurons in the subsequent layers. 

BPA has been designed to recognize any nonlinear relation between input 
and output. In the absence of non-linearity, it implements a linear transfor- 
mation at each layer. The nonlinear function evaluated at each neuron in 
middle and output layer(s) is called an activation function. Sigmoidal func- 
tion is generally used as an activation function; it is continuous, monotonically 
increasing, continuously differentiable and asymptotically approaches fixed fi- 
nite values as the input approaches infinity (-f or -). An example of Sigmoidal 
function is 

where A = Logistic gain. 

The effect of ’A’ is to modify the shape of sigmoidal function. 

Finally, in brief, the steps involved in BPA are: 

1. Preprocess or scale the data. 

2. Generate the initial random weights. 

3. Evaluate the network output for a data set. 

4. Calculate the error signal. 

5. Modify the weights using the error signal. 

6. Repeat firom (3) to (5). 

7. Repeat firom (3) to (6). 
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Chapter 3 


Parameter Estimation Methods 


3.1 General 

In this chapter, we describe the salient features of the Delta method and the 
Zero method used for estimating the aircraft parameters from flight data. Both 
the techniques use the motion variables and control inputs as the input file 
while the aerodynamic coefficients are presented as the output file for training 
the neural network. The trained network is a neural model of the aircraft 
aerodynamics. For the purpose of parameter estimation, the trained neural 
network is presented with a suitably modified input file (these modifications 
are explained in later sections), and the corresponding predicted output file 
of aerodynamic coefficients is obtained. Suitable interpolation and manipu- 
lation of such input-output files yields the estimated values of the unknown 
parameters. 

3.2 The Delta method 

The stability and control derivatives occurring in the equations of motion of 
an aircraft represent partial derivatives of aerodynamic force and moment co- 
efficients with respect to the corresponding motion or control input variables. 
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In other words, these derivatives can be thought of as variations in the aero- 
dynamic coefficient due to small variation in one of the motion or control 
variables about the nominal value in such a way that only that particular 
variable is allowed to change, while the rest of the variables are held constant 
at their nominal values. This fundamental understanding is exploited in the 
Delta method for estimating parameters. 

Let us now assume that FFNN is already trained to map the network 
input variables to the output variables. Now only one of the network inputs 
is given a small (delta. A) perturbation at each time point (hence the name 
Delta method) while all others are held at their original values. Such a mod- 
ified input file is now presented to the trained neural network to predict the 
perturbed value of aerodynamic coefficients (output) at its output node. The 
difference in the predicted value of the aerodynamic coefficient from the value 
predicted for the original values of inputs is due to the perturbation in the 
value of the chosen network input variable. The difference so calculated in the 
value of aerodynamic coefficient divided by the perturbation value yields the 
corresponding aircraft parameter. 

For example, say /?, is perturbed by small value Ayd and difference ob- 
served in the predicted value of (7/ for /? and P + Ap is AQ. Then ^ yields 
the stability derivative Q/3- Similarly perturbation in 6a and corresponding 
ACn observed will yield control derivative C„, 5 a, where To avoid 

bias due to one sided differences, both motion and control variables are per- 
turbed in both increasing and decreasing direction. For example Cy values for 
P -f Ap and p — A/3 are predicted to be Cy'^ and Cy~ respectively, then 



3.3 The Zero method 


The Zero method is based on interpreting the stability and control deriva- 
tives as follows: if we could obtain variation in the value of an aerodynamic 
coefficient due to variation in only one of the motion/control variables while 
the other motion/control variables are identically zero, then the ratio of the 
aerodynamic coefficient to the non-zero motion/control variable will yield the 
corresponding stability/control derivative. Let us say that the FFNN is trained 
to map the network input variables (^), (^), 0, 5a and 5r to the network out- 
put variable Ci. Now one input variable at a time is chosen to be at its original 
value while the rest of the network inputs are set to zero (hence the name Zero 
method). The predicted value of the aerodynamic coefficient corresponding to 
such a modified file is divided by the non-zero motion/control variable to yield 
the corresponding stability/control derivative. 

To illustrate the method for the lateral-directional case, let us say the 
rolling moment coefficient has the functional form Q = f(^, y, /3, 5a, 5r). 
Let Cl can be written as 

Cl = + Qriy) + C,oP + C,uSa + C„rSr ( 3 . 2 ) 

Although it is not required to postulate an aerodynamic model of Eq. (3.2), 
it has been done only to facilitate explanation of the Zero method. After 
the network has been trained to achieve the functional relation, it is used for 
the prediction phase as follows. The trained network is allowed to predict Ci 
corresponding to the input file consists of (^, y=0, j3=0, 5a=0 and 5r = 0). 
Let the predicted Ci be denoted by C*. The C* represents the variation in 
Cl with (^) while r=/?=(5a=(yr=0. As evident from Eq. (3.2), the ratio of 
Ci* to (^) will yield the derivative C/p = ^ry. Similarly all the parameters 
of the above equation can be estimated by using suitably modified input files. 
Furthermore, the trained networks using Cn and Cp as the output files can be 
used to estimate the C„ and Cp derivatives. 
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The above procedure will be valid w'hen C/o, Cno and C^o are identically 
zero. If C/o, C„o and Cyo have non-zero values, the procedure needs modifi- 
cation as follows: after the aerodynamic coefficients are predicted as before 
we would need to estimate the trim values of force and moment coefficients 
(Q, Cn and Cy) ahead of estimating parameters. For this purpose, adl the 
netw'ork inputs are set to zero and the corresponding predicted aerodynamic 
coefficients would be the desired estimates of trim values. Let the estimated 
values be C/o, C„o and Cyo- Now the parameter estimates are obtained by 
dividing (C/* — C/o), (Cn* - Cno) and {Cy* — Cyo), instead of just C/* , Cn* 
and Cy* as was done earlier, by the corresponding non-zero motion/control 
variables. For example, 


C/p = 


C/* - C/o 
(^) ’ 


a 


Cn* - c, 


nO 


nf3 




^ySa — 


Cy*-a 


yO 


5a 


etc. 


(3.3) 


A few additional considerations common to both the proposed methods 
are discussed next. 

It is noted that both the methods yield one estimated value at each time 
point, i.e., one estimate for each of the training pair used. Ideally all such values 
should have been identical to yield a single value of the parameter. However, 
in reality, there are variations in the predicted values. It is conjectured that 
such variations may be due to a less-than-perfect match between the actual 
and the predicted values of the network output variables C/, Cn and Cy. This 
suggested that, after the estimates are arranged in a descending or an ascending 
order, extreme values may be ignored. Practical experience with many sets 
of simulated data guided the removal of 25% estimates from either end of the 
so ordered set of estimates. To study the spread of estimates, histograms of 
all the estimated values were plotted (Fig. 5.5, discussed later). Since the 
histograms showed a near normal distribution, the mean value is used as the 
estimated value and the standard deviation about the mean as the measure of 
accuracy of the estimates. 


17 



Chapter 4 


Aerodynamic Modelling using 
Feed Forward Neural Networks 


4.1 General 

In this chapter, we describe the types of simulated flight data generated and 
real flight data taken for our study. Details of example airplane used and the 
type of control inputs utilized for generating simulated flight data are given. 
Flight data with biases, scale factors, with and without pseudo measurement 
noise, and with time shift were prepared for analysis. Next, the data pre- 
processing done for the real flight data is discussed; both the processed data 
(corrected for biases, scale factors and time shifts) as well as the raw data (only 
corrected for time shifts) are used for parameter estimation via the Delta and 
the Zero methods^^. Finally, the FFNN model for lateral-directional aircraft 
aerodynamics is presented. 

At the outset, it may be emphasized that we need neither the equations of 
motion nor their solutions for the FFNN modelling and subsequent parameter 
estimation via the proposed methods. It is only for the purpose of generating 
simulated flight data that the equations of motion are considered. 



4.2 Simulated Flight Data Generation 


The example aircraft selected for generating simulated flight data is the re- 
search aircraft ATTAS for which we were supplied real flight data by the 
Institute of Flight Mechanics, DLR, Germany, for analysis at our end. The 
nominad values of mass and moment of inertia used for data generation, and 
the geometrical characteristics of the ATTAS aircraft are summarized in 
Table 4.1. 

Table 4.1 Geometric, mass and inertia characteristics of ATTAS 

aircraft (Ref. 15) 


Mean chord 

c 

= 

3.159 ra 

Half wing span 

s 

= 

21.50 m 

Wing area 

s 


64.00 m2 

mass 

m 

= 

16352.23 kg 

Moment of inertia 

h 

= 

162314.20 kg-m2 


h 

= 

252687.00 kg-m^ 


Iz 

=: 

388440.00 kg-m2 


^xz 

= 

11442.00 kg-m2 


The six-degree-of-freedom equations of motion^® in a body-fixed axis sys- 
tem fixed to the center of gravity of the aircraft are given by Eq. (4.1). 

u = —qw + rv — g sin 9 + —Cx 

m 

V = —ru + pw -I- g eos 9 sin cp -I Cy 

m 




w = —pv + qu + g cos 9 cos <f)—Cz 

m 


^ = p -f - 9 sin tan 0 4- r cos 0 tan 0 
Ip = qsm4sec9 — rcos^sec9 

■' v „ ■■■■ ■ ^XZ ■ 

{qSs{hC„ + 1,,Q) - + 1.) + p?{4 - J,/, + /|) } 

(4.1) 


/ r — p 

-‘xz 
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For the purpose of simulating lateral-directional dynamics, Eq. (4.1) are re- 
duced to three-degree-of-freedom equations of motion as shown below: 


V = — ru -I- ^sin(^ + ^ Cj, 

P = 77 -- - fi {qSsihCl -r IxzCn)} 

-‘x-'i -'xz 

r = {g5s(/xC„ IxzCi)} 

^ = P (4.2) 


where, 

V = \/ + v'^ + 

q = 

The aircraft is assumed to be symmetrical about the X-Z plane, and hence, 
the cross products of inertia Ixy and lyz are equal to zero. Also, the thrust 
components are all neglected. The equations of motion are solved for the 
flight condition defined by a landing flap deflection 5/ = SP (1 deg), indi- 
cated airspeed Vias = 160 Kn, and using the estimated values of parameters 
(via ML method) in Ref. 15 as the true values; the true values of parameters 
used are showjt in Table 4.2. The Eq. (4.2) are solved using the fourth-order 
Runge-Kutta ajgorithm. The moment and force coefficients (Cj, C„ and Cy) 
are calculated by using Eq. (4.3) 


a = 

= 

a = 


C,0 + C„ (^)+ Or (^) + QsH + Cu.Sa + QsrSr 


CM+C„J~)+C^r 


(^) 




Cvc + C„(^'\+ C,. (^] + C,,/3 + + C,ir5T (4.3) 
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Fable 4.2 True values of parameters used for generating simulated 

flight data (Ref. 15) 


Cip = -0.9782 

Cnp = -0.1153 

Cyp = 0.3029 

Clr = 0.4181 

Cnr = -0.4949 

Cyr = 0.7273 

Ci0 = -0.1264 

Cn0 “ 0.2805 

Cy^ = -1.1328 

Cisa = -0.2469 

^n6a =0.0 

Cyia = 0.0293 

Cisr = 0.0465 

Cn6r ~ ”0.1609 

Cyir = 0.1914 

C;o = 0.00099 

Cao = 0.00161 

CjK) = -0.00454 


4.2.1 Control Input Forms 


The multi-step 3-2-1-1 type inputs are capable of better excitation of aircraft 
dynamics to increase the information content in the responses, and thereby, 
lead to better estimates via any of the existing pareimeter estimation methods 
such as the maximum likelihood method and the filter error method. Similar 
observations for the Delta and the Zero methods^^ have been confirmed in 
Refs. 13 and 14. A multistep 3- 2-1-1 type of input consists of control deflection 
for 3,2,1 and 1 second in -t-ve, -ve, -+-ve, and -ve direction respectively. The 
maximum magnitude was kept at 0.1 radians. In the present work, multi-step 
3-2-1-1 type aileron and rudder inputs, aileron input followed by, after a 1 
second interval, rudder input were used, and corresponding forced response of 
8 sec duration was used for training the FFNN. The control inputs used for 
simulation along with the response obtained are shown in Fig. 4.1, and the 
computed aerodynamic coefficients are shown in Fig. 4.2. 

4.2.2 Different types of simulated flight data used for 
parameter estimation 

The simulated flight response so obtained is analyzed as it is, and also af- 
ter introducing varying amounts of bias, scale factor, measurement noise, and 
time shift errors in the motion variables; the value of bias and scale factor is a 
multiple of the values estimated for the real flight data as given in Ref. 15. 
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To study the effect of noise in simulated flight data, different levels of 
pseudonoise (1, 5 and 10%) was added to p, r, /3, Ci, and Cy. This 
pseudonoise was simulated by generating successively uncorrelated pseudo- 
random numbers having a normal distribution with zero mean and assigned 
a standard deviation, the standard deviation corresponding approximately to 
the designated percentage (1 and 5%) of the maximum amplitude of the corre- 
sponding variable. To study the effect of bias in flight data, varying amounts 
of biases were added to the p, r, /? responses; the biases p*, rj, and /?6 were 1 
to 10 times the values shown in Table 4.3. To study the scale factor effects, 
the /d response was corrupted with the scale factor equals to 1.075 (as shown 
in Table 4.3). Finally, to study the effect of time shift, flight data with time 
shift values of Table 4.3 were prepared for analysis. 

The main findings of the present study are illustrated by presenting re- 
sults for the following cases of simulated data. 


Case 1 : Simulated flight data with no measurement errors. 

Case 2 : data of case 1, but specific amount of measurement noise 

(1%, 5% and 10%) added to p,r,/?, C/,Cn and Cy. 


Case 3 ; data of case 2, but with p, r, 0 corrupted with bias 

equals to the estimated values for the real flight data, 
i.e., P+P6, r-f-rt, and are assumed to be the 
signals available for training the FFNN. 

Case 4 : data of case 3, but (5 corrupted with scale factor = 1.075, 

which equals the value estimated for the real flight data. Thus, 
the /3 signal available is assumed to be given by 


Case 5 : data of case 2, but with p, r, P corrupted with bias equals 

to 5 times the estimated values. The signals available are 
p-f5p6, r-f-Srt, and 


Case 6 : data of case 5, but p corrupted with scale factor 

= 1.075. The signal becomes A:^/5+5,5t. 


OA 



The simulated flight data for case 2 to case 6 were analyzed for varying 
amounts of measurement noise (1%, 5% and 10%). To facilitate discussion of 
results, the type of data for a specific case (2 to 6) is identified by the following 
notation. Say, case 3N5 is used to denote case 3 data with noise equals to 5% 
(No stands for noise = 5%). Similarly case 2N1 means case 2 data with 1% 
noise, and case 6N10 means case 6 data with 10% noise. 


4.3 Real Flight-Data Supplied by DLR for 
ATTAS Aircraft 

The real flight data of the ATTAS aircraft supplied (shown in Fig. 4.3) by the 
Institute of Flight Mechanics, DLR, Germany, consists of raw data for mea- 
sured u, a, /3, p, q, r, Ox, Cy, a^, p, r, H, T, 5a, and 5r, and information about 
the fuel consumption and the locations of all the measuring instruments. The 
measurement of true airspeed (V), angle-of-attack (a) and angle of side-slip 
(/?) were obtained with a flight log mounted on a boom in front of the aircraft 
nose. The angular rates p,q and r were obtained from measurements available 
from the inertial platform. The accelerations along the three body fixed axes 
were measured using an accelerometer triad located near the center of gravity 
of the aircraft. The angular accelerations p and f were obtained by numerical 
differentiation of the corresponding angular rates. The control surface deflec- 
tions (Sa and 5r) were measured using potentiometers’. The digital air data 
computer was used to record altitude (H) and outside air temperature (T). 

4.3.1 Preprocessing of Real-Flight Data 

Real flight-data generally have unknown biases, scale factors and time shifts in 
the recorded data. These introduce data incompatibility. Thus it is imperative 
that the data compatibility check is carried out before using the data for 
aerodynamic modelling and parameter estimation by conventional methods 





like the ML method. 


Using the estimated biases, scale factors and the known offset-distances 
of measuring instruments from the center of gravity^®, the measured flight 
variables that are required for FFNN modelling, are corrected as follows: The 
corrected value of the side-slip angle P is obtained from 

P = sin~^{^) (4.4) 

where v = 4- p -f- r 

and u„ = V sin((/?„,„ - A/?)/ kp) 

The Pnm is the side-slip angle measured at the nose vane, V is the measured 
airspeed, kp and A/? are the estimated scale factor and bias respectively, Xn 
and Zn are the distances of vane frorri the C.G. along the X and Z directions 
respectively. 

The corrected value of lateral acceleration Oy at C.G of aircraft is obtained 
from the accelerometer recording along the Y-axis using 

ay = aym-(pq + r)Xa + (r^ + p^)Ya - (rq - p)Za (4.5) 

where Uym is the measured value at a point Xa, To distances away from 

the center of gravity. 

The measured angular rates {pmAm and r„,) are corrected for the bias 
error to obtain p, q and r as follows: 

p = Pm-Pb; q = qm-qb; r = rm-n 

The angular rates p, q and r are also corrected for the time delays by shifting 
the time tag of the measured quantity by the estimated time shift. Estimates 
of time delays suggested that the recorded values of p, q and r (available at 
interval of 0.05 sec.) be shifted by one time interval of 0.05 sec., i.e., the nth 
value be labelled as (n-l)th^®. 
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- 0.03 





by DLR. 



Thus the raw data supplied by DLR was corrected for the time delays 
and bias errors in angular rates, the scale factor and bias error for angle of 
side-slip and the offset of the measuring accelerometer from C.G. of the aircraft 
for the lateral acceleration. All the correction factors utilized above axe listed 
in Table. 4.t3. 

In addition to the above corrections done, for good aerodynamic mod- 
elling and parameter estimation, one should know about the aircraft mass 
characteristics, such as mass, moment of inertia, and position of the center of 
gravity. The information about fuel consumption supplied with the flight-data 
was used to incorporate the necessary corrections and thereby estimate the 
aircraft mass, the moment of inertia and the center of gravity location as a 
function of time. 

The fuel-flow meter recordings for the respective flight segments were 
integrated to get the total fuel consumed from the time of take-off, and its 
subtraction from the take-off' weight yielded the actual weight at any time 
during the flight. In order to account for the variation of and Ig due to the 
change in fuel loading, following least square fits have been used. 

4 = 104431.0 + 6.31626(W/) + 0.0021277(W/)^ 

Ig = 331864.0 ^ 5.53291(W;) -H 0.0022477(117/)^ (4.6) 

where Ig and -ig are the moment of inertia of the aircraft along X and Z axes 
and Wf is the fuel weight available at any given time during the flight. The 
variation in ly and Igg due to fuel load changes were estimated to be small, and 
therefore, constant value of ly = 252687.0 Kg-m^ and 7*^ = 11442.0 Kg-m^ has 
been used in aerodynamic modelling and parameter estimation. The other two 
cross product of inertia, namely Ixy and lyg, are small and hence neglected. 
Finally, to account for the variation in the location of center of gravity with 
fuel consumption, the empirical method outlined in Ref. 15 was used. This 
yielded the G.G. location corresponding to each time point where the flight 
data is recorded. A fixed reference point (10.12m, Om, 2.8m) is chosen to serve 
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as the origin of the body-fixed axes system. A geometrical reference system 
(Fig. 4.4) has been defined^® for the transformation of forces and moments 
about the C.G fixed axes system to the reference point fixed axes system. 
Next, the offsets of the reference point from the center of gravity at any point 
were calculated. Let the position of the C.G. relative to the reference point be 
denoted by AAcgj cg AZcg- The roll and yaw moment coeflBcients 
referred to the reference point (denoted by superscript R) are given by 

s s 

+ (4.7) 

s s 

where Ci, and Cy are the moment and force coefficients in body-fixed axes 
system referred to the center of gravity. These Q, C„ and Cy are in turn 
computed from the following equations. 

Q = ^ [p/x - r/xx - pqlxz + ?r(/x - /„)] 

Gn = qSs "b q'^Ixz ~ PQ{^x -^v)] 

C'v = ^ [oym -ipq + r)Xa + (r^ + p'^)Y^ - (rq - p)Z„] (4.8) 

We also defined the roll and yaw moment coefficients in the experimental 
axes system (shown in Fig. 4.5) by applying the following axes transformations: 

Cr = Ci^cosa — Cn^sina 

Cn = Ci^sina — Cn^cosa (4-9) 

where subscript ‘e’ denotes moment coefficients in the experimental axes sys- 
tem attach, to the reference point. 
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HE: Horizontal plane 
ME: Median plane 
Q E: Transverse plane 



Fig. 4.4 Geometric reference system (Ref. 15) 
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Fig. 4.5 Axes system (Ref. 15) 



4.3.2 Two different ways of analyzing the real flight data 


The real flight data of ATTAS aircraft (Fig. 4.3) can be used in many differ- 
ent ways. Fig. 4.3 shows three significant segments, denoted by I, II and III, 
corresponding to where the control inputs are of relatively large magnitude, and 
thereby, the response is also large. One can estimate the parameters by using the 
flight segments as follows: 

i) considering the whole flight data 

ii) considering only the segment I 

iii) considering concatenated segments I and II 

iv) considering concatenated segments I, II and III 

A quick study of all the four options showed that the option (iv) of using 
concatenated segments I, II and III yielded the best results (the reasons and re- 
sults are discussed later in Chapter 5). For the data corresponding to the option 
(iv), the following are the two different ways of analyzing the real flight data, used 
for parameter estimation via the Delta and the Zero methods. 

Case R1 : Recorded (real) flight data corrected for the 

bias, the scale factor and the time shift errors using their 
estimates given in Ref. 15 and shown in Table 4.3. 

Case R2 : Recorded raw flight data for p, r, /? and 

p and r corrected for the time shift only. 

4.4 Aerodynamic Modelling 

The purpose of aerodynamic modelling using FFNNs is to establish a functional 
relation between the aircraft aerodynamic coefficient and the measurable aircraft 
motion and control variables. 
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The choice of the input variables for a particular aerodynamic coefficient 
is dictated by the physical understanding of the phenomenon governing this 
dependence. Once the input and output variables for the FFNN are selected, 
the FFNN model of aircraft aerodynamics is achieved without the need of a 
formal model structure formulation. 

The problem of modelling aircreift aerodynamics by use of FFNN consists 
of two phases, namely i) learning or training phase and ii) prediction phase. 

During the training phase (explained in chapter 2 along with BPA algo- 
rithm) , the network captures the functional relationship existing between the 
inputs and the outputs (not necessarily in the same form as in the original 
physical model) in terms of weights. Once the training is over, the network 
weights and topology is frozen, and the same input data is passed through the 
network to check its prediction capability. 

A good prediction capability implies good aerodynamic modelling. Thus, 
a good aerodynamic modelling is imperative for success of the Delta and the 
Zero methods used for estimating parameters from flight-data. There are 
many so called influencing or tuning parameters (discussed in chapter 2) of 
the FFNN that affect the training and thereby prediction capabilities of the 
network. A proper selection of tuning parameters is necessary for the given 
set of training data. Unfortunately, there are no definite rules for selection 
of these network parameters and yet, one has to find the best possible set 
of parameters by trial and error, guided by a set of thumb rules available in 
literature. The matrix of tuning parameters that was used to find the best 
possible architecture is given in Chapter 5. 

In the present work, for lateral-directional modelling, the input file con- 
sists of roll rate (ps/V), yaw rate (rs/V), angle-of-side-slip (/?), aileron deflec- 
tion (5a) and rudder deflection (Sr). The output file has rolling moment (Gj) 
or yawing moment (Cn) or side force coefficient (Cy). The schematic of FFNN 
for lateral-directional aerodynamic modelling is shown in Fig. 4.6. 
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inputs output 

input hidden output 

layer layer layer 

Fig, 4.6 Schematic of FFNN for lateral-directional 

aerodynamic modelling 

It may he clarified that the input variables to the FFNN need not be 
limited to only, those mentioned above. For the simulated flight data, the 
choice of the input variables is obvious since the variables involved in the 
equations of motion used for generating the data are known. In the case of 
real flight data, it may be desirable to include all possible variables of which the 
aerodynamic coefficients may be a function of. Thus any nonlinear functional 
relation between the aerodynamic coefficients and motion/control variables can 
be easily mapped to obtain the aerodynamic model of the aircraft, without any 
need for an a priori model. 
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Chapter 5 


Results and Discussion 


5.1 General 

The simulated flight data for lateral-directional dynamics of an aircraft are 
analyzed for varying amounts of measurement errors in the motion variables. 
The real flight data with and without correcting for measurement errors are 
also analyzed. The parameters estimated from both simulated as well as real 
flight data are presented and compared with the ML estimates of Ref. 15. The 
network input file consisted of motion variables (p, r, /3) along with aircraft 
control inputs {Sa and Sr). The network output file is either Cj or C„ or Cy. 
The network is trained using such input-output files for many such sets of 
simulated and real flight data. 

For each data set, an individual optimal architecture was searched by 
varying the network tuning parameters; specifically, the variations in the num- 
ber of neurons in the hidden layers (3-6), the learning rate (0.2-0.8), the mo- 
mentum rate (0.3-0. 9), the random seed (0.3-0. 9), the logistic gain (0.7-0.95), 
and the number of iterations (500-15,000) were tried, and the architecture 
with the lowest mean square error (MSE) and high correlation coefficient was 
selected. 

Although, we found the best possible optimum architecture, it is possible 
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that a slight variation in the network tuning parameters may result in still lower 
MSE for the specific set of flight data. Since the present work is concerned 
with parameter estimation via the Delta and the Zero methods/^ we refrain 
from reporting detailed discussion on training phase and effects of network 
parameters on the MSE, and thereby on the correlation obtained between the 
desired and the predicted values of Cj or C„ or Cj,. The effect of network tuning 
parameters on training was similar to that reported in the literature^^’^®. 

As already described (Chapter 3), the application of the Delta method 
requires small (A) perturbation of network inputs. A brief study was carried 
out for 0.01 and 0.001 as the perturbation value, and the results were almost 
identical (marginally better for 0.001). For convenience and consistency, it 
was, therefore, decided to keep the perturbation fixed at 0.001 for all cases 
reported in the thesis. 

It is worth mentioning that in real life, the p and r required for computing 
Cl and C„ would generally be obtained by numerical differentiation of the 
recorded p and r signals. In this context, for simulated data of case 2 to 
6, the only signals of p and r assumed to be available for differentiation are 
the p and r signals contaminated with the measurement errors. Also for real 
flight data (case R2), the measured (sensor) signals of p and r are assumed 
to be available for differentiationj»i.e., the recorded p and r signals are used 
without correcting them for the bias and scale factor errors. This is done 
to account for any additional inaccuracies that might creep in the parameter 
estimates through the process of numerical differentiation of the signals having 
measurement errors. 

For the purpose of numerical differentiation, a centrally pivoted 5-point 
algorithm is used. The algorithm w^ first checked for signals having no mea- 
surement errors in them. A detail^study showed that the computed values of 
the first derivative via the numericzil differentiation compared well with the 
analytical values except at a few points near the maxima and minima of p 
and r signals. Practical considerations suggested that a few data ( up to 4) ^ 
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in the neighborhood of the maxima and minima of the p and r signals be left 
out of the data set to be used for training the FFNN. Similarly for the real 
flight data (case R2) also, a few points are omitted: the omitted data are from 
the neighborhood of the maxima and minima of the raw signals of p and r 
(containing the bias and scale factor errors). The p and r so obtained are used 
to compute the required C; and Cn from Eq. (4.8). 


5.2 Results for Simulated Flight Data 

As a first step, a study was undertaken to asses the effect of number of itera- 
tions on the accuracy of the estimated parameters. For this purpose, for case 
1, the architecture of the network wzis kept fixed while the number of itera- 
tions were varied from 500 to 15,000. It was found that the MSE decreased 
upto about 5000 iterations, and beyond it, the decrease was only marginal. 
However, the sample standard deviations and the accuracy of the estimated 
parameters did improve beyond 5000 iterations, and up to about 10,000 iter- 
ations. This was specially true for the weak derivatives as may be seen from 
Table 5.1, wherein the parameter estimates from simulated flight data via the 
Delta method and the Zero method and compared for the number of iterations 
equal to 5000 and 10,000. Thus, the number of iterations was kept fixed at 
10,000 for all the cases studied and reported here in. 

It is of interest to compare the actual Cf, C„ and Cj, with those computed 
using the estimated values of the parameters. Using the estimated parameters, 
estimated aerodynamic coeflBcients C;, Cn and Cj, are obtained from the ex- 
pression on the right hand side of the Eq. (4.3) . Along with these, trained 0;, 
C„ and Cy from the neural network are also shown in Fig. 5.1. Prom Fig. 5.1, 
it may be seen that the actual and trained Ci,’ C„ and Cy are indistinguishable 
on the scale of the figure, and the estimated Ci, Cn and Cy corresponding to 
the Delta method show good match with the ^tual values. 

A detailed study has been carried out to obser\'e the effects all measure- 
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ment errors in various possible combinations, i.e., the measurement errors are 
introduced in the data individually, or tw at a time, or three at a time, or 
all at a time. In other words, the simulated data with no measurement errors 
(case 1) is corrupted with different levels of noise, bias, scale factor and time 
shift errors. In all the cases studied, it was observed that presence of time 
shift in any of the motion variables resulted in poor estimates, irrespective of 
whether any other measurement errors were present or not. Thus, it was con- 
cluded that the estimation of parameters from the Delta and the Zero methods 
required that the data be first corrected for any time shift errors before its use 
for the training of network, and subsequently for parameter estimation via the 
Delta or the Zero method. It is, therefore, necessary that the time delay in the 
recorded data should be estimated either via data compatibility check, or from 
estimates of possible transport delays in specifications for inertial platform. 

The estimated parameters from flight data with varying amounts of mea- 
surement errors (measurement noise, bias and scale factor) are presented in the 
following tables; 


Table 5.2 : estimates via the Delta method from simulated data with 1 % 

noise, and bias and scale factor corresponding to case 2 to 
case 6, i.e., for the cases designated by case 2N1, case 3N1, 
case 4N1, case 5N1, and case 6N1. 


Table 5.3 


estimates via the Zero method for cases same as for Table 5.2. 


Table 5.4 : similar to cases for Table 5.2, but with measurement noise 

increased to 5%, i.e., for cases designated by case 2N5 to 
case 6N5. 


Table 5.5 
Table 5.6 

Table 5.7 


estimated via the Zero method for cases same as for Table 5.4, 

similar to cases for Table 5.2, but with measurement noise 
increased to 10%, i.e., for cas^ 2N10 to 6N10. 

estimated via the Zero method for cases same as for Table 5.6. 
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Effect of measurement noise on parameter estimates 

The estimated parameters for case 2N1 show that in spite of addition of 1% 
measurement noise to flight data, all the parameters are still well estimated. 
Comparison of estimates for case 2N1 via the Delta method (Table 5.2) and 
the Zero method (Table 5.3) shows that the Delta method yields relatively 
better estimates. This superiority becomes more obvious for higher levels of 
measurement noise as may be seen by comparing results for the Delta method 
and the Zero method for case 2N5 and case 2N10 corresponding to 5% and 
10% measurement noise (Tables 5.4 to. 5.7). 

Effect of bias on parameter estimates 

The estimated parameters via the Delta method for case 3N1 and case 5N1 
in Table 5.2 show that the estimates are hardly affected by the presence of 
bias in the flight data even in presence of measurement noise increased to 5% 
(case 3N5, Table 5.4) and 10% (case 3N10, Table 5.6), the parameters are well 
estimated for biases of (p^, rj, j3i,) and (Spt, 5vt„ 5Pb) in flight data. Thus, the 
Delta method is quite robust with respect to presence of any bias errors in the 
data. 

In contrast, the parameter estimates via the Zero method from the bi- 
ased data show rapid degradation as the bias and/or measurement noise levels 
increase. This is clearly by results for case 3 and case 5 for all the three mea- 
surement noise levels, i.e., for case 3N1 and case 5N1 in Table 5.3, case 3N5 
and- case 5N5 in Table 5.5, and case 3N10 and case 5N10 in Table 5.7. It is 
worth noting that the p and r derivatives like C/p, C„p, Cyp, C/r, Cnr and Cyr 
are poorly estimated for the biased data. 

It may be recalled that the Zero method utilizes the predicted total 
force/moment coefficient for, one at a time, non-zero motion/control variable 
in the input file, and the stability /control derivative is then computed by 
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C'xi = where x = 1, m, n; i = p, r, /?, Ja, 6r. The computation 

involves division by the motion \'ariable i = p, r, or 3 which has bias as well as 
measurement noise in it, and also it uses estimated Cxo value. It is conjectured 
that the results via the Zero method are adversely affected due to division by 
biased motion variables and by inaccurate estimates of Cio- 

On the other hand, the Delta method utilizes the generalization prop- 
erties of the FFNN that allow the network to interpolate and extrapolate, as 
required. Thus, even if the network is trained on biased and/or noisy data, the 
prediction of output corresponding to the perturbed, one at a time, network 
input variable is well performed, and therefore, the estimated parameters given 
by Cxi = are accurately predicted. 

Effect of scale factor on parameter estimates 

For parameter estimation via the Delta method, the addition of scale factor 
to /? response seems to affect the /? derivatives like C/p, C^p and Cyp, albeit 
marginally, as shown in Tables 5.2, 5.4 and 5.6 for, respectively, (case 4N1 and 
case 6N1), (case 4N5 and case 6N5) and (case 4N10 and case 6N10). However, 
the results for the same cases via the Zero method shown in Tables 5.3, 5.5 and 
5.7 indicate that the estimated parameters are poorly estimated. Of course, it 
must be pointed out that the case 4 and case 6 are for the flight data having 
noise and bias in addition to the scale factor error. In a separate study (results 
not given), it was observed that the scale alone did result in good estimates 
via the Delta method, but most of the estimates via the Zero method were 
poor. 

It is also of interest to compare the actual C/, Cn and Cy with those 
computed using the estimated values of parameters (via the Delta method) for 
case 6N5, where all the measurement errors (except the time shift) are present 
in the data. Such comparison was shown in Fig. 5.2. Along with these, trained 
Cl, C„ and Cy from neural network are also shown in the figure. From Fig. 
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5.2, it may be seen that the trained and the estimated Ci, C„ and Cy are close 
to each other on the scale of the figure. 

To bring out the superiority of the parameter estimates via the Delta 
method as compared to the Zero method, the parameter estimates from the 
same flight data (case 6N5) via the both the methods are used to compute 
the corresponding total coefficients Cj, C„ and Cy using Eq. (4.3). These 
coefficients are compared in Fig. 5.3 with the actual total coefficients used 
in generating the simulated flight data for case 6N5. As seen from Fig. 5.3, 
the coefficients Q, C„ and Cy bcised on the Delta method show much better 
matching with the actual coefficients. 

The above results for parameter estimation for simulated data have clearly 
indicated that the Delta method is quite robust with respect to measurement 
errors. Thus, for any practical applications wherein the measured data is likely 
to have measurement errors, the Delta method should be used for parameter 
estimation. 

Effect of utilizing free response for parameter estimation 

All the results presented so far, utilized only the forced response of 8 seconds 
duration corresponding to the 8 seconds duration for which the control inputs 
5a and/or Sr are applied. It is interest to see how the accuracy of estimates is 
affected by increasing the signal length by including part of the free response 
that follows the forced response. To this purpose the 8 seconds forced re- 
sponse and the next 4 seconds free response were used together to analyze the 

m ■ 

resulting 12 seconds response shown in Fig. 5.4 (designated as segment I in 
Fig. 5.4). The segment I data was analyzed as it is (without introducing any 
measurement errors) and corresponding to case 6N5 (5 times bias, scale factor 
and 5% measurement noise) analyzed earlier; the results via the Delta method 
from segment I are compared with the earlier case 1 and case 6N5 in Table 5.8. 
For case 1 the results improve marginally when analyzed with free response. 
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However, for case 6N5, the estimates without free response are slightly better. 
Again, as discussed for earlier cases, the Delta method yields better results 
than the Zero method (results not presented for the Zero method). Thus, 
there seems no need and no advantage to be gained by including any portion 
of the free response with the forced response when analyzing recorded data for 
parameter estimation via the Delta method. 

Finally, we also investigated if reasonable parameter estimates could be 
obtained via the Delta and the Zero methods by using only the free response 
portion of the flight data (segment II in Fig. 5.4). In this case, the input file 
for training the FFNN consists of the motion variables p, r and P only. The 
results are shown in Table 5.9. Because the p, r, P responses damp out quickly, 
the information content in the free response is not adequate, and therefore, the 
accuracy of the estimates is poor. Therefore, we recommend the parameter 
estimation should not be attempted using the free response alone. 

Before concluding discussion about results for simulated flight data, it 
is recalled that both methods yield as many estimates of the parameters as 
there are the data points, since each training pair of the data set results in a 
corresponding parameter estimate. The spread of these estimates is illustrated 
in Fig. 5.5 for the estimates obtained via the Delta method for case 6N5. The 
figure also lists the mean values and the sample standard deviations of the 
estimated parameters along with the true values for ready comparison. A 
near-normal distribution of the estimated values is observed for most of the 
parameters. 

5.3 Results for Real Flight Data 

The real flight data of case Rl is essentially the same for which parameter 
estimates via the Delta method are given by Ghosh et al’^^ (it is referred to as 
case 9 in Ref. 13). However, in the present study, the flight data was divided 
into smaller segments and three segments, marked I, II and III in Fig. 4.3, are 
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concatenated to yield the flight data for case R1 and case R2. For case Rl, 
the data is corrected for any bias, scale factor and time shift; the estimates of 
bias, scale factor and time shift from Table 4.3 are utilized for the purpose. 
For case R2, the data is corrected for the time shift only. 

It may be mentioned that the initial conditions for the motion variables 
were neither required nor estimated; during the network training, the input 
vector only needs to be paired with the corresponding target vector represent- 
ing the desired output. This fact can be used advantageously to increase the 
information content of the input-output pairs selected for the parameter esti- 
mation via the Delta and Zero methods^^: from the total recorded signal, the 
data corresponding to where the magnitude of the motion variables is rela- 
tively large are selected and used for training the network. In case of the Delta 
and Zero methods, the partitioning of the longer duration manoeuvre into 
several time segments and their concatenation does not require estimation of 
unknown initial conditions for each segment separately. On the other hand, 
the output error methods do necessarily require estimation of initial conditions 
whenever the data of several segments is concatenated. Thus the Delta and 
Zero methods^^ can take advantage of concatenated data without the laborious 
and time consuming requirement of estimating many initial conditions. 

Incidentally, it may be mentioned that such partitioning of real flight 
data was not resorted to in Ref. 13; the present study shows that, from the 
same real flight data, better estimates are obtained by such concatenation of 
selected time segments as compared to the results in Ref. 13 obtained by using 
the total signal length. The estimated parameters for case Rl (for both the 
Delta and Zero methods) are listed in Table 5.10 along with the estimates 
from the same data via the Delta method in Ref. 13 and via the ML method 
in Ref. 15. Assuming the ML estimates of Ref. 15 to be the nominal values 
for the purpose of comparison, Table 5.10 shows that the use of concatenated 
data (case Rl, the Delta method) results in improved accuracy of estimates 
as compared to the estimates reported in Ref. 13. Table 5.10 also shows that 
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the Zero method results are relatively poor as compared to those via the Delta 
method. The control derivatives C^sa and CySr are estimated poorly by both 
the Delta and the Zero methods; a possible reason for it is discussed later. 

Fig. 5.6 shows the comparison of the actual total coefiBcients Q, C„ and 
Cy (obtained by Eq. (4.8), using real flight data), with the estimated coeffi- 
cients, computed by Eq. (4.3) using the estimated parameters via the Delta 
method and Ref. 13. The estimated coefficients corresponding to estimates 
via the Delta method show a better match with actual coefficients than those 
corresponding to Ref. 13. 

Data for case R2 consists of the recorded raw data of p, r, /?, and aym- 
The p and r signals are corrected for the time shift only as per estimates given 
in Table 4.3. Thus, the recorded signals are neither checked nor corrected for 
the presence of measurement noise or the measurement errors like the bias and 
the scale factor. The raw signals of p and r (after correcting for time shift) are 
numerically differentiated to get p and r, and these, along with recorded aym 
are used to compute Ci, Cn and Cy by Eq. (4.8). The network is trained with 
the so computed Q, Cn or Cy as the network output, and the recorded motion 
and control variables (corrected for time shift only) as the network inputs. The 
estimated parameters (from both the Delta and the Zero methods) for case R2 
are given in Table 5.10; as seen from the table, most of the parameter estimates 
via the Delta method compare well with the estimates of Ref. 15 and case Rl. 
Furthermore, the parameters via the Zero method are again relatively poor 
as compared to those from the Delta method. Thus, the earlier observations 
about the Delta method being more robust with respect to the measurement 
errors is also confirmed by the results for the real flight data. 

A comment about the real flight data analyzed is in order. Although 
the flight data supplied by DLR are of very high quality, the data have been 
generated by similar looking Sa and 5r inputs applied simultaneously (segment 
I in Fig 4.3) followed by pulse type <ia inputs (segments II and III in Fig. 
4.3). As pointed out Ref. 13, segment I type of control inputs for generating 
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flight data are not what one would recommend for generating flight data for 
parameter estimation via the Delta and Zero methods;!^ the control inputs 
of 5a and Sr with a time delay between application of 5a and 5r, like those 
used for simulated data (cases 1-6), are to be preferred and would yield better 
results. The presence of segment I type of control inputs may also be the 
reason for consistently poor estimation of Cj,ia and for both cases R1 
and R2 data analyzed by the Delta and the Zero methods. Notwithstanding 
the above shortcoming of the real flight data, the applicability of the Delta 
and Zero 'methods'^ to raw sensor data for parameter estimation has been 
demonstrated. 

It is of interest to compare the total coefficients Q, Cn and Cy computed 
using the parameter estimates obtained via the Delta method for case R2, and 
the ML method (Ref. 15). Such a comparison shown in Fig. 5.7, along with 
the actual total coefficients obtained from Eq. (4.8) using the real flight data. 
To help in distinguishing the three Ci curves, Fig. 5.7 shows a small portion of 
the Cl versus time plot on a enlarged scale (x4). It may be seen from Fig. 5.7 
that the Ci, Cn and Cy based on estimates from neither the Delta method nor 
the ML method (Ref. 15) show a clear cut or uniformly better matching with 
the actual total coefficients. Thus, it is difficult to claim superiority of either 
of the methods, i.e., the Delta method or the maximum likelihood method. 
On the other hand, it may be pointed out that, unlike the ML method, the 
Delta method‘s does not require a guess for a reasonable set of initial values 
of the parameters. Furthermore, the estimates from the proposed methods 
are obtained by using the recorded data without correcting it for bias or scale 
factor errors as was required and done before the same data was used for the 
ML method in Ref. 15. 


44 



Table 5.1 Effect of the number of iterations on estimated 
parameters from flight data of case 1 


Parameter 

True Value 

Delta method 
I = 5000 

Zero method 

I = 5000 

Delta method 

I = 10000 

Zero mehtod 

I = 10000 

MSE 

- 

650 X 10“® 

646 X 10-® 

556 X 10-® 

538 X 10“® 

Cip 

-0.3782 

-1.074 

-1.197 

-1.063 

-1.182 



(0.052)t 

(0.069) 

(0,051) 

(0.050) 

Clr 

0.4181 

0.450 

0.582 

0.430 

0.531 



(0.052) 

(0.155) 

(0.069) 

(0.020) 

Cij 

-0.1264 

-0.128 

-0.138 

-0.125 

-0.136 



(0.009) 

(0.011) 

(0.008) 

(0.005) 

'ClSa 

-0.2469 

-0.251 

-0.240 

-0.251 

-0.240 



(0.012) 

(0.022) 

(0.014) 

(0.025) 

Cur 

0.0465 

0.042 

0.044 

0.042 

0.043 



(0.005) 

(0.006) 

(0.004) 

(0.002) 

Qo 

0.0009 

- 

-0.0006 

- 

-0.0005 

.MSE 

- 

201 X 10-® 

193 X 10-» 

144 X 10-» 

141 X 10“® 

Cftp 

-0.1153 

-0.133 

-0.124 

-0.108 

-0.122 



(0.027) 

(0.011) 

(0.025) 

(0.013) 

Cnr 

-0.4949 

-0.589 

-0.708 

-0.622 

-0.723 



(0.141) 

(0.018) 

(0.058) 

(0.017) 

Cn^ 

0.2805 

0.279 

0.300 

0.277 

0.294 



(0.014) 

(0.032) 

(0.013) 

(0.008) 

'CnSa 

0.00 

0.007 

0.004 

-0.002 

0.001 



(0.021) 

(0.017) 

(0.006) 

(0.005) 

Cf^jf 

-0.1659 

-0.173 

-0.181 

-0.173 

-0.179 



(0.013) 

(0.010) 

(0.009) 

(0.011) 

CnO 

0.0016 

- 

0.0022 

- 

0.0019 

'■ "'MSE 

. 

697 X 10-* 

665 X 10-® 

443x 10“® 

429x 10“® 

.Cup, 

0.3029 

0.303 

0.307 

0.291 

0.282 



(0.138) 

(0.098) 

(0.144) 

(0.054) 

, Cff ■ 

0.7273 

0.601 

0.698 

0.667 

0.742 



(0.079) 

(0.107) 

(0.078) 

(0.020) 

. 

-1.1328 

-1.095 

-1.178 

-1.098 

-1.212 



(0.082) 

(0.075) 

(0.075) 

(0.048) 


0.0293 

0.031 

0.035 

0.025 

0.029 



(0.019) 

(0.017) 

(0.015) 

(0.010) 

I'*"' ■ ' ' 

0.1914 

0.191 

0.198 

0.194 

0.207 



(0.024) 

(0.039) 

(0.021) 

(0.032) 

CyO 

-0.0045 

m 

-0.0059 


-0.0046 


t Sample standard deviatioa 



Table 5.2 Effect of bias and scale factor on parameter estimates via 
the Delta method. Measurement noise: 1%. 


Parauneter 

True Value 

Case 2N1 

Case 3N1 

Case 4N1 

Case 5N1 

Case 6N1 

Qp 

-0.9782 

-1.054 

-1.054 

-1.054 

-1.053 

-1.053 



(0.054)t 

(0.054) 

(0.054) 

(0.055) 

(0.055) 

Clr 

0.4181 

0.431 

0.431 

0.431 

0.431 

0.431 



(0.071) 

(0.071) 

(0.071) 

(0.072) 

(0.072) 

Cl0 

-0.1264 

-0.124 

-0.124 

-0.115 

-0.123 

-0.116 



(0.008) 

(0.008) 

(0.007) 

(0.008) 

(0.007) 

CiSa 

-0.2469 

-0.249 

-0.249 

-0.249 

-0.249 

-0.249 



(0.016) 

(0.016) 

(0.016) 

(0.016) 

(0.016) 

^I6r 

0.0465 

0.043 

0.043 

0.043 

0.043 

0.043 



(0.004) 

(0.004) 

(0.004) 

(0.004) 

(0.004) 

Cnp 

-0.1153 

-0.116 

-0.117 

-0.117 

-0.118 

-0.118 



(0.026) 

(0.026) 

(0.026) 

(0.027) 

(0.027) 

Cnr 

-0.4949 

-0.600 

-0.600 

-0.600 

-0.600 

-0.600 



(0.058) 

(0.058) 

(0.058) 

(0.058) 

(0.058) 

Cn/? 

0.2805 

0.278 

0.278 

0.260 

0.278 

0.260 



(0.012) 

(0.012) 

(0.012) 

(0.013) 

(0.012) 


0.00 

-0.002 

-0.002 

-0.002 

-0.002 

-0.002 



(0.006) 

(0.006) 

(0.006) 

(0.007) 

(0.007) 

CfiJr 

-0.1659 

-0.172 

-0.173 

-0.173 

-0.172 

-0.172 



(0.009) 

(0.009) 

(0.009) 

(0.010) 

(0.010) 

Cpp 

0.3029 

0.311 

0.312 

0.313 

0.317 

0.317 



(0.148) 

(0.149) 

(0.149) 

(0.151) 

(0.150) 

Cyr 

0.7273 

0.652 

0.651 

0.651 

0.648 

0.649 



(0.071) 

(0.072) 

(0.072) 

(0.073) 

(0.073) 


-1.1328 

-1.104 

-1.104 

-1.032 

-1.105 

-1.032 

f 


(0.074) 

(0.074) 

(0.069) 

(a074) 

(0.069) 


0.0293 

0.024 

0.025 

0.025 

0.025 

0.025 



(0.016) 

(0.016) 

(0.017) 

(0.017) 

(0.017) 


0.1914 

0.194 

0.194 

0.194 

0.194 

0.194 



(0.020) 

(0.021) 

(0.021) 

(0.020) 

(0.020) 

■ ■ . • 


t Sample standard deviation 
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Table 5.3 EflFect of bias and scale factor on parameter estimates via 
the Zero method. Measurement noise: 1%. 


Parameter 

True Value 

Case 2N1 

Case 3N1 

Case 4N1 

Case 5N1 

Case 6N1 

Cip 

-0.9782 

-1.179 

-1.188 

-1.188 

-1.211 

-1.209 


(0.052)t 

(0.048) 

(0.048) 

(0.042) 

(0.042) 

Qr 

0.4181 

0.537 

6.547 

0.547 

0.583 

0.581 


(0.021) 

(0.021) 

(0.021) 

(0.021) 

(0.020) 

Cl0 

-0.1264 

-0.133 

-0.135 

-0.126 

-0.139 

-0.130 


(0.005) 

(0.005) 

(0.005) 

(0.005) 

(0.005) 

CiSa 

-0.2469 

-0.238 

-0.241 

-0.241 

-0.251 

-0.251 


(0.025) 

(0.023) 

(0.024) 

(0.016) 

(0.016) 

CiSr 

0.0465 

0.043 

0.043 

0.043 

0.044 

0.044 


(0.001) 

(0.001) 

(0.001) 

(0.001) 

(0.001) 

Cio 

0.0009 

-0.0005 

0.0001 

0.0001 

0.0030 

0.0028 

Cnp 

-0.1153 

-0.126 

-0.115 

-0.116 

-0.074 

-0.077 



(0.014) 

(0.014) 

(0.014) 

(0.015) 

(0.015) 

Cnr 

-0.4949 

-0.705 

-0.702 

-0.703 

-0.682 

-0.684 



(0.017) 

(0.017) 

(0.017) 

(0.017) 

(0.017) 

Cnp 

0.2805 

0.297 

0.298 

0.279 

0.301 

0.281 


(0.008) 

(0.008) 

(0.008) 

(0.008) 

(0.008) 

CnSa 

0.00 

0.001 

0.003 

0.003 

0.012 

0.011 


(0.007) 

(0.008) 

(0.008) 

(0.010) 

(0.010) 

CnSr 

-0.1659 

-0.179 

-0.179 

-0.179 

-0.174 

-0.174 

(0.011) 

(0.012) 

(0.012) 

(0.016) 

(0.016) 

CnO 

0.0016 

0.0022 

0.0007 

0.0008 

-0.0052 

-0.0047 1 


0.3029 

0.275 

0.219 

0.223 

-0.008 

0.010 

V/yp 

(0.057) 

(0.054) 

(0.054) 

(0.038) 

(0.039) ! 

c. ^ 

0.7273 

0.725 

0.711 

0.711 

0.640 

0.647 

\jyr 


(0.019) 

(0.019) 

(0.019) 

(0.017) 

(0.017) 

Cpp 

-1.1328 

-1.222 

(0.049) 

-1.228 

(0.049) 

-1.148 

(0.046) 

-1.248 

(0.045) 

-1.165 

(0.043) 

CySa 

0.0293 

0.029 

(0.014) 

0.022 

(0.015) 

0.023 

(0.015) 

-0.009 

(0.020) 

-0.006 

(0-020) 

CySr 

0.1914 

0.209 

(0.031) 

0.207 

(0.031) 

0.207 

(0.031) 

0.194 

(0.029) 

0.196 

(0.029) 

Cpo 

-0.0045 

-0.0047 

0i)014 

0.0010 

0.0267 

0.0246 


■(• Sample standard deviation 
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Table 5.4 EflFect of bias and scale factor on parameter estimates via 
the Delta method. Measurement noise: 5%. 


Parameter 


C,p 

C/. 

ClSa 

^ISr 


'-'np 

Cnr 

CnSa 


Cyr 

Cj/0 

Cy6p 

CySr 


True Value 

Case 2N5 

Case 3N5 

-0.9782 

-1.013 

-1.102 


(0.071)t 

(0.072) 

0.4181 

0.405 

0.404 


(0.074) 

(0.074) 

-0.1264 

-0.118 

-0.118 


(0.008) 

(0.008) 

-0.2469 

-0.240 

-0.240 


(0.023) 

(0.024) 

0.0465 

0.043 

0.043 


(0.005) 

(0.005) 

-0.1153 

-0.129 

-0.130 


(0.034) 

(0.035) 

-0.4949 

-0.588 

-0.585 


(0.061) 

(0.060) 

0.2805 

0.280 

0.280 


(0.013) 

(0.013) 

0.00 

0.001 

0.001 


(0.009) 

(0.009) 

-0.1659 

-0.171 

-0.171 


(0.011) 

(0.010) 

0.3029 

0.352 

0.356 


(0.168) 

(0.173) 

0.7273 

0.600 

0.595 


(0.090) 

(0.092) 

-1.1328 

-1.109 

-1.109 


(0.070) 

(0.070) 

0.0293 

0.028 

0.029 


(0.024) 

(0.026) 

0.1914 

0.192 

0.192 


(0.020) 

(0.020) 


Case 4N5 

Case 5N5 

Case 6N5 

-1.012 

-1.006 

-1.007 

(0.072) 

(0.076) 

(0.076) 

0.404 

0.400 

0.400 

(0.074) 

(0.074) 

(0.074) 

-0.110 

-0.117 

-0.109 

(0.007) 

(0.008) 

(0.007) 

-0.240 

-0.238 

-0.238 

(0.024) 

(0.025) 

(0.025) 

0.043 

0.043 

0.043 

(0.005) 

(0.005) 

(0.005) 

-0.130 

-0.136 

-0.135 

(0.035) 

(0.038) 

(0.038) 

-0.586 

-0.575 

-0.576 

(0.060) 

(0.059) 

(0.059) 

0.261 

0.279 

0.261 

(0.012) 

(0.013) 

(0.012) 

0.001 

0.001 

0.001 

(0.009) 

(0.011) 

(0.011) 

-0.171 

-0.170 

-0.170 

(0.011) 

(0.011) 

(0.011) 

0.356 

0.372 

0.371 

(0.173) 

(0.192) 

(0.190) 

0.595 

0.580 

0.581 

(0.092) 

(0.094) 

(0.094) 

-1.036 

-1.108 

-1.036 

(0.065) 

(0.067) 

(0.063) 

0.029 

0.030 

0.030 

(0.026) 

(0.034) 

(0.033) 

0.192 

0.192 

0.192 

(0.020) 

(0.019) 

(0.019) 


t Sample standard deviation 
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Table 5.5 Effect of bias and scale factor on parameter estimates via 
the Zero method. Measnrement noise: 5%. 


Parameter 


C/p 

C/r 


C//i 

C/fa 

C/fr 

C/0 


'.'np 

C„r 

Cn/3 

Cnfa 

Cnir 

CnO 


Cpp 

Cyr 

C,0 

Cpfa 

Cpfp 

Cpo 


True Value 

Case 2N5 

Case 3N5 

-0.9782 

-1.164 

-1.176 


(0.060)t 

(0.056) 

0.4181 

0.509 

0.520 


(0.021) 

(0.021) 

-0.1264 

-0.127 

-0.129 


(0.007) 

(0.007) 

-0.2469 

-0.229 

-0.232 


(0.030) 

(0.029) 

0.0465 

0.041 

0.042 


(0.002) 

(0.002) 

0.0009 

-0.0011 

-0.0005 

-0.1153 

-0.113 

-0.102 


(0.020) 

(0.021) 

-0.4949 

-0.702 

-0.697 


(0.017) 

(0.017) 

0.2805 

0.301 

0.303 


(0.008) 

(0.008) 

0.00 

0.005 

0.008 


(0.011) 

(0.013) 

-0.1659 

-0,177 

-0.176 


(0.012) 

(0.013) 

0.0016 

0.0022 

0.0007 

0.3029 

0.251 

0.195 


(0.057) 

(0.054) 

0.7273 

0.652 

0.638 


(0.017) 

(0.017) 

-1.1328 

-1.226 

-1.234 


(0.051) 

(0.051) 

0.0293 

0.041 

0.034 


(0.034) 

(0.037) 

0.1914 

0.210 

0.207 


(0.030) 

(0.030) 

-0.0045 

-0.0057 

0.0005 


Case4N5 

Case 5N5 

Case6N5 

-1.175 

-1.212 

-1.210 

(0.056) 

(0.044) 

(0.044) 

0.520 

0.563 

0.560 

(0.021) 

(0.021) 

(0.021) 

-0.121 

-0.136 

-0.126 

(0.006) 

(0.007) 

(0.006) 

-0.232 

-0.242 

-0.242 

(0.029) 

(0.023) 

(0.023) 

0.042 

0.042 

0.042 

(0.002) 

(0.002) 

(0.002) 

-0.0005 

0.0023 

0.0020 

-0.103 

-0.058 

-0.062 

(0.021) 

(0.023) 

(0.023) 

-0.698 

-0.666 

-0.670 

(0.017) 

(0.017) 

(0.017) 

0.282 

0.307 

0.287 

(0.008) 

(0.009) 

(0.008) 

0.008 

0.020 

0.019 

(0.013) 

(0.017) 

(0.017) 

-0.176 

-0.168 

-0.169 

(0.013) 

(0.017) 

(0.017) 

0.0008 

-0.0053 

-0.0048 

0.199 

-0.031 

-0.013 

(0.054) 

(0.039) 

(0.040) 

0.639 

0.592 

0.595 

"(0.017) 

(0.015) 

(0.014) 

-1.152 

-1.258 

-1.175 

(0.048) 

(0.049) 

(0.046) 

0.035 

-0.001 

0.002 

(0.037) 

(0.053) 

(0.052) 

0.207 

0.191 

0.193 

(0.031) 

(0.030) 

(0.030) 

0.0001 

0.0257 

0.0236 


t Sample standard deviation 
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Table 5.6 Effect of bias and scale factor on parameter estimates via 
the Delta method. Measurement noise: 10%. 


Parameter 

True Value 

Case 2N10 

Case 3N10 

Case 4N10 

Case 5N10 

Case 6N10 

Cip 

-0.9782 

-0.909 

-0.903 

-0.904 

-0.883 

-0.885 



(0.092)t 

(0.093) 

(0.093) 

(0.095) 

(0.095) 

C,r 

0.4181 

0.350 

0.349 

0.349 

0.348 

0.349 



(0.070) 

(0.070) 

(0.070) 

(0.068) 

(0.068) 

Cii3 

-0.1264 

-0.102 

-0.101 

-0.095 

-0.099 

-0.092 



(0.012) 

(0.012) 

(0.011) 

(0.013) 

(0.013) 

CiSa 

-0.2469 

-0.218 

-0.217 

-0.217 

-0.214 

-0.214 



(0.028) 

(0.029) 

(0.029) 

(0.029) 

(0.029) 

CiSr 

0.0465 

0.038 

0.038 

0.038 

0.039 

0.039 



(0.004) 

(0.005) 

(0.005) 

(0.006) 

(0.006) 

Cnp 

-0.1153 

-0.132 

-0.133 

-0.133 

-0.134 

-0.134 



(0.036) 

(0.037) 

(0.037) 

(0.042) 

(0.042) 

Cnr 

-0.4949 

-0.533 

-0.528 

-0.528 

-0.514 

-0.515 



(0.061) 

(0.063) 

(0.063) 

(0,067) 

(0.067) 


0.2805 

0.280 

0.280 

0.261 

0.280 

0.261 



(0.013) 

(0.013) 

(0.012) 

(0.014) 

(0.013) 

^nSa. 

0.00 

0.005 

0.005 

0.005 

0.006 

0.006 



(0.015) 

(0.016) 

(0.016) 

(0.020) 

(0.020) 

0 fi(5r 

-0.1659 

-0.167 

-0.167 

-0.167 

-0.166 

-0.166 



(0.011) 

(0.011) 

(0.011) 

(0.011) 

(0.011) 

Ci/« 

0.3029 

0.358 

0.365 

0.364 

0.388 

0.386 

yp 


(0.190) 

(0.198) 

(0.197) 

(0.228) 

(0.226) 

Cyr 

0.7273 

0.531 

0.527 

0.527 

0.514 

0.514 



(0.089) 

(0.093) 

(0.092) 

(0.107) 

(0.106) 


-1.1328 

-1.115 

-1.115 

-1.042 

-1.113 

-1.040 


(0.069) 

(0.069) 

(0.064) 

(0.065) 

(0.061) 


0.0293 

0.032 

0.033 

0.033 

0.040 

0.040 


(0.058) 

(0.063) 

(0.062) 

(0.079) 

(0.078) 


0.1914 

0.190 

0.190 

0.190 

0.192 

0.192 



(0.018) 

(0.018) 

(0.018) 

(0.017) 

(0.018) 


t Sample standard deviation 
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Table 5.7 Effect of bias and scale factor on parameter estimates via 
the Zero method. Measurement noise: 10%. 


Parameter True Value Case 2N10 Case 3N10 Case 4N10 Case 5N10 Case 6N10 


Cip 

-0.9782 

-1.132 

(0.064)^ 

Qr 

0.4181 

0.444 

(0.021) 

Ci0 

-0.1264 

-0.115 

(0.009) 

CiSa 

-0.2469 

-0.208 

(0.035) 

CiSr 

0.0465 

0.045 

(0.005) 

CfO 

0.0009 

-0.0023 

Cnp 

-0.1153 

-0.085 

(0.024) 

Cnr 

-0.4949 

-0.668 

(0.016) 

CnfS 

0.2805 

0.311 

(0.009) 

Cn<5a 

0.00 

0.011 

(0.018) 

CnSr 

-0.1659 

-0.174 

(0.011) 

CnO 

0.0016 

0.0023 

Cyp 

0.3029 

0.218 

(0.040) 

Cyr 

0.7273 

0.588 

(0.015) 


-1.1328 

-1.232 

(0.052) 


0.0293 

0.059 

(0.067) 

CySr 

0.1914 

0.207 

(0.027) 

CyO 

-0.0045 

-0.0078 


-1.144 

-1.143 

-l.|84 

-1.181 

(0.062) 

(0.062) 

(0.052) 

(0.053) 

0.453 

0.453 

0.495 

0.491 

(0.021) 

(0.021) 

(0.023) 

(0.023) 

-0.117 

-0.109 

-0.126 

-0.117 

(0.009) 

(0.008) 

(0.010) 

(0.009) 

-0.210 

-0.210 

-0.216 

-0.216 

(0.035) 

(0.035) 

(0.032) 

(0.032) 

0.046 

0.046 

0.049 

0.048 

(0.005) 

(0.005) 

(0.005) 

(0.005) 

-0.0018 

-0.0018 

0.Q0O7 

0.0005 

-0.073 

-0.074 

-0.Q26 

-0.030 

(0.025) 

(0.025) 

(0.026) 

(0.026) 

-0.661 

-0.661 

-0.626 

-0.629 

(0.016) 

(0.016) 

(0.016) 

(0.016) 

0.313 

0.292 

0.320 

0.298 

(0.009) 

(0.009) 

(0.009) 

(0.009) 

0.015 

0.014 

0.031 

0.030 

(0.020) 

(0.020) 

(0.028) 

(0.028) 

-0.173 

-0.173 

-0.165 

-0.166 

(0.012) 

(0.012) 

(0.016) 

(0.016) 

0.0007 

0.0008 

-0.0Q55 

-0.0050 

0.167 

0.170 

-0.0^8 

-0.013 

(0.035) 

(0.036) 

(0.015) 

(0.017) 

0.584 

0.584 

0.600 

0.594 

(0.015) 

(0.015) 

(0.023) 

(0.022) 

-1.241 

-1.159 

-1.273 

-1.187 

(0.053) 

(0.049) 

(0.056) 

(0.052) 

0.054 

0.054 

0.023 

0.026 

(0.074) 

(0.073) 

(0.096) 

(0.095) 

0.205 

0.206 

0.198 

0.199 

(0.027) 

(0.027) 

(0.025) 

(0.025) 

-0.0018 

-0.0022 

0.0235 

0.0214 


t Sample standard deviation 
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Table 5.8 Effect of including free response for parameter estimation 

via the Delta method. 


parameter True Value Case 1 Case 1 Case 6N5 Case 6N5 

+ + 

Free Response Free Response 


Qp 

-0.9782 

-1.063 
(0.051) t 

C(r 

0.4181 

0.430 

(0.069) 

Ci0 

-0.1264 

-0.125 

(0.008) 

C(io 

-0.2469 

-0.251 

(0.014) 

Qsr 

0.0465 

0.042 

(0.004) 

Cnp 

-0.1153 

-0.108 

(0.025) 

Cnr 

-0.4949 

-0.622 

(0.058) 

Cn0 

0.2805 

0.277 

(0.013) 

Cnfa 

0.00 

-0.002 

(0.006) 

CnSr 

-0.1659 

-0.173 

(0.009) 

Cyp 

0.3029 

0.291 

(0.145) 

Cyr 

0.7273 

0.667 

(0.078) 

Cy0 

-1,1328 

-1.098 

(0.075) 

OySa 

0.0293 

0.025 

(0-015) 

CySr 

0.1914 

0.194 

(0.021) 


-0.951 

-1.007 

-0.850 

(0.018) 

(0.076) 

(0.038) 

0.440 

0.400 

0.497 

(0.010) 

(0.074) 

(0.020) 

-0.125 

-0.109 

-0.109 

(0.002) 

(0.007) 

(0.004) 

-0.243 

-0.239 

-0.222 

(0.004) 

(0.025) 

(0.005) 

0.049 

0.043 

0.057 

(0.001) 

(0.005) 

(0.003) 

-0.097 

-0.135 

-0.153 

(0.019) 

(0.037) 

(0.028) 

-0.472 

-0.576 

-0.510 

(0.035) 

(0.059) 

(0.023) 

0.280 

0.261 

0.264 

(0.007) 

(0.012) 

(0.009) 

0.003 

0.001 

-0.001 

(0.004) 

(0.011) 

(0.006) 

-0.166 

-0.170 

-0.169 

(0.005) 

(0.010) 

(0.004) 

0.310 

0.371 

0.417 

(0.072) 

(0.190) 

(0.021) 

0.779 

0.581 

0.919 

(0.087) 

(0.094) 

(0.067) 

-1.147 

-1.036 

-1.067 

(0.025) 

(0.063) 

(0.035) 

0.034 

0.030 

0.044 

(0.007) 

(0.033) 

(0.005) 

0.205 

0.192 

0.216 

(0.007) 

(0.019) 

(0.008) 


t Sample standard deviation 
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Table 5.9 Effect of estimated parameters via the Delta axid the Zero 
methods, considering only free response 
(with no measurement errors). 


Parameter 

True Value 

Delta method 

Zero method 


-0.9782 

-0.0945 

-0.0882 

Clr 


(0.038)t 

(0.105) 

0.4181 

0.6247 

0.6471 



(0.018) 

(0.043) 

-0.1264 

-0.0416 

-0.0615 

Cio 


(0.004) 

(0.020) 

0.0009 

- 

0.0002 

C„p 

-0.1153 

-1.3340 

-1.0536 



(0.090) 

(0.074) 

Cnr 

-0.4949 

-0.8825 

-0.6487 



(0.067) 

(0.210) 

0.2805 

0.1769 

0.2321 



(0.010) 

(0.083) 

CnO 

0.0016 

- 

0.0021 

C„p 

0.3029 

2.8268 

2.6033 



(0.300) 

(0.197) 

Cyr 

0.7273 

1.2563 

1.305 


(0.339) 

(0.796) 


-1.1328 

-0.8550 

-0.8692 



(0.080) 

(0.223) 

Cpo 

-0.0045 


-0.0059 


t Sample standard deviation 


Table 5.10 Parameter estimates from real flight data via 
tlie Delta and the Zero methods. 


Parameter 

ML 

Ref. 13 

Case R1 
Delta method 

ri 

-0.9782 

-0.866 

-0.943 


(0.20)* 

(0.013)* 

(0.030) 

Cir 

0.4181 

0.594 

0.509 

(0.43) 

(0.028) 

(0.060) 

Cif) 

-0.1 264 

-0.110 

-0.102 

(0.39) 

(0.003) 

(0.014) 


-0.2469 

-0.209 

-0.237 

(0.20) 

(0.004) 

(0.020) 

CMr 

0.04G5 

0.027 

0.016 

(0.90) 

(0.007) 

(0.026) 

Qo 

- 

- 


C„p 

-0.1153 

-0.068 

-0.101 


(0.73) 

(0.003) 

(0.032) 

Cnr 

-0.4949 

-0.864 

-0.544 


(0.56) 

(0.026) 

(0.087) 

Cn/J 

0.2805 

0.264 

0.273 

(0.07) 

(0.005) 

(0.009) 

OfiSa 

0.0 


0.014 

(0.003) 

CnSr 

■0.1659 

-0.169 

-0.165 

(0.12) 

(0.004) 

(0.013) 

CnO 

- 

* 

* 


0.3029 

0.111 

0.304 


(5.18) 

(0.025) 

(0.065) 

Cyr 

0.7273 

1.146 

1.810 


(2.32) 

(0.G03) 

(0.188) 


-1,1328 

-1.083 

-0.996 

(0.33) 

(0.049) 

(0.032) 

.Oyia 

0.0293 

0.129 

0.116 

(13.5) 

(0.011) 

(0.046) 

■ OySf 

0.1914 

0.095 

0.009 

(2.02) 

(0.008) 

(0.053) 

Oyd 

- 

- 



Case R2 
Delta method 

Case R1 
Zero method 

Case R2 
Zero method 

-0.899 

-0.841 

-0.916 

(0.068) 

(0.027) 

(0.035) 

0.666 

0.437 

0.608 

(0.100) 

(0.101) 

(0.081) 

-0.136 

-0.132 

-0.159 

(0.016) 

(0.006) 

(0.006) 

-0.224 

-0.222 

-0.220 

(0.031) 

(0.007) 

(0.008) 

0.034 

-0.028 

0.016 

(0.016) 

(0.022) 

(0.020) 

- 

0.0010 

0.0008 

-0.158 

-0.099 

-0.160 

(0.031) 

(0.018) 

(0.011) 

-0.567 

-0.679 

-0.497 

(0.055) 

(0.053) 

(0.054) 

0.237 

0.261 

0.242 

(0.013) 

(0.011) 

(0.012) 

-0.007 

0.011 

-0.013 

(0.010) 

(0.007) 

(0.004) 

-0.180 

-0.229 

-0.224 

(0.010) 

(0.007) 

(0.010) 

- 

0.0025 

0.0024 

0.266 

0.362 

0.410 

(0.060) 

(0.014) 

(0.018) 

1.950 

1.322 

1.109 

(0.125) 

(0.494) 

(0.119) 

-1.153 

-0.994 

-1.089 

(0.157) 

(0.060) 

(0.089) 

0.117 

0.041 

0.069 

(0.047) 

(0 016) 

(0.004) 

0.124 

0.014 

0.031 

(0.069) 

(0012) 

(0.021) 


0.0030 

-0.0012 


* Standard (Icviation in percent as in Ref. 18 
t Sample standard deviation 


54 









57 



0.05 



58 




59 



Actual 

Trained 

Estimated 



60 



Actual 





Actual 

Delta 

Zero 



63 






64 









65 


Fig. 5.5 Histograms forC|, Cr and C derivatives ( case 6N5 yia the Delta method. 
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Fig. 5.6 Comparison of total aerodynamic coefficients for real flight data 
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Fig. 5.6 Continued. 
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Fig. 5.7 Gomparison of total aerodynamic coefficients for real flight data 








Chapter 6 


Conclusions 


Applicability of the recently proposed Delta and Zero methods^^ for extracting 
aircraft parameters from simulated and real flight data has been demonstrated 
for the flight data containing unknown bias, scale factor and measurement 
noise. The recorded flight data is required to be corrected only for the time 
shift errors before applying the methods. The superiority of the Delta method 
over the Zero method, when used for estimating parameters from recorded 
data that contain measurement errors, has been demonstrated. The presence 
of bias and scale factor in recorded signals is shown to marginally affect the 
estimated parameters via the Delta method.The FFNN is able to establish a 
mapping between the network inputs of recorded motion and control variables 
and the network outputs computed using the recorded motion variables. It is 
conjectured that, in spite of the fact that the input-output mapping uses the 
recorded data directly (without corrections for bias and scale factor), the gen- 
eralization properties of the FFNN enable it to correctly predict the modified 
output for the perturbed network input, and thus leading to good estimates 
of parameters via the Delta method. 

The results of the present study enhance the scope of the proposed 
methods^^; the recorded data can be used directly without worrying about 
measurement errors (expect for the time shift). Furthermore, the concatena- 
tion of flight segments can be used to increase the information content of the 
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data without any requirement of estimating or matching the initial conditions 
of each segment. The results also help in exploring the potential of the pro- 
posed methods for on-line aerodynamic modelling and parameter estimation. 
For on-line parameter estimation, only the coefficient network needs to be car- 
ried on-board. The coefficients can be estimated using the aircraft sensors. 
Thus, such a network could quickly learn on-line to map the current motion 
and control inputs to the total coefficients, and yield parameter estimates for 
on-line use. 
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